Benchmarking in the SWISSspine registry: results of 52 Dynardi lumbar total disc replacements compared with the data pool of 431 other lumbar disc prostheses

The SWISSspine registry is the first mandatory registry of its kind in the history of Swiss orthopaedics and it follows the principle of "coverage with evidence development". Its goal is the generation of evidence for a decision by the Swiss federal office of health about reimbursement of the concerned technologies and treatments by the basic health insurance of Switzerland. Recently, developed and clinically implemented, the Dynardi total disc arthroplasty (TDA) accounted for 10% of the implanted lumbar TDAs in the registry. We compared the outcomes of patients treated with Dynardi to those of the recipients of the other TDAs in the registry. Between March 2005 and October 2009, 483 patients with single-level TDA were documented in the registry. The 52 patients with a single Dynardi lumbar disc prosthesis implanted by two surgeons (CE and OS) were compared to the 431 patients who received one of the other prostheses. Data were collected in a prospective, observational multicenter mode. Surgery, implant, 3-month, 1-year, and 2-year follow-up forms as well as comorbidity, NASS and EQ-5D questionnaires were collected. For statistical analyses, the Wilcoxon signed-rank test and chi-square test were used. Multivariate regression analyses were also performed. Significant and clinically relevant reduction of low back pain and leg pain as well as improvement in quality of life was seen in both groups (P < 0.001 postop vs. preop). There were no inter-group differences regarding postoperative pain levels, intraoperative and follow-up complications or revision procedures with a new hospitalization. However, significantly more Dynardi patients achieved a minimum clinically relevant low back pain alleviation of 18 VAS points and a quality of life improvement of 0.25 EQ-5D points. The patients with Dynardi prosthesis showed a similar outcome to patients receiving the other TDAs in terms of postoperative low back and leg pain, complications, and revision procedures. A higher likelihood for achieving a minimum clinically relevant improvement of low back pain and quality of life in Dynardi patients was observed. This difference might be due to the large number of surgeons using other TDAs compared to only two surgeons using the Dynardi TDA, with corresponding variations in patient selection, patient-physician interaction and other factors, which cannot be assessed in a registry study.

Benchmarking with Spine Tango: potentials and pitfalls

The newly released online statistics function of Spine Tango allows comparison of own data against the aggregated results of the data pool that all other participants generate. This comparison can be considered a very simple way of benchmarking, which means that the quality of what one organization does is compared with other similar organizations. The goal is to make changes towards better practice if benchmarking shows inferior results compared with the pool. There are, however, pitfalls in this simplified way of comparing data that can result in confounding. This means that important influential factors can make results appear better or worse than they are in reality and these factors can only be identified and neutralized in a multiple regression analysis performed by a statistical expert. Comparing input variables, confounding is less of a problem than comparing outcome variables. Therefore, the potentials and limitations of automated online comparisons need to be considered when interpreting the results of the benchmarking procedure.